Evolution of Complex Autonomous Robot Behaviors using Competitive Fitness

نویسنده

  • A. L. Nelson
چکیده

Evolutionary Robotics (ER) employs population-based artificial evolution to develop behavioral robotics controllers. In this paper we focus on the formulation and application of a fitness selection function for ER that makes use of intra-population competitive selection. In the case of behavioral tasks, such as game playing, intra-population competition can lead to the evolution of complex behaviors. In order for this competition to be realized, the fitness of competing controllers must be based mainly on the aggregate success or failure to complete an overall task. However, because initial controller populations are often subminimally competent, and individuals are unable to complete the overall competitive task at all, no selective pressure can be generated at the onset of evolution (the Bootstrap Problem). In order to accommodate these conflicting elements in selection, we formulate a bimodal fitness selection function. This function accommodates sub-minimally competent initial populations in early evolution, but allows for binary success/failure competitive selection of controllers that have evolved to perform at a basic level. Large arbitrarily connected neural network-based robot controllers were evolved to play the competitive team game Capture the Flag. Results show that neural controllers evolved under a variety of conditions were competitive with a hand-coded knowledge-based controller and could win a modest majority of games in a large tournament.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Evolution of Complex Autonomous Robot Behaviors

Evolutionary Robotics (ER) employs population-based artificial evolution to develop behavioral robotics controllers. In this paper we focus on the formulation and application of a fitness selection function for ER that makes use of intra-population competitive selection. In the case of behavioral tasks, such as game playing, intra-population competition can lead to the evolution of complex beha...

متن کامل

Competitive Relative Performance and Fitness Selection for Evolutionary Robotics

Nelson, Andrew Lincoln. Competitive Relative Performance and Fitness Selection for Evolutionary Robotics. (Under the direction of Dr. Edward Grant.) 1 Evolutionary Robotics (ER) is a field of research that applies evolutionary computing methods to the automated design and synthesis of behavioral robotics controllers. In the general case, reinforcement learning (RL) using high-level task perform...

متن کامل

Cooperative and Competitive Behavior Acquisition for Mobile Robots through Co-evolution

This paper discusses how multiple robots can emerge cooperative and competitive behaviors through co-evolutionary processes. A genetic programming method is applied to individual population corresponding to each robot so as to obtain cooperative and competitive behaviors. The complexity of the problem can be explained twofold: coevolution for cooperative behaviors needs exact synchronization of...

متن کامل

Evolution of behaviors in autonomous robot using artificial neural network and genetic algorithm

In distributed autonomous robot (agents) systems, each robot (predator or prey) must behave by itself according to its states and environments, and if necessary, must cooperate with other robots in order to carry out a given task. Therefore it is essential that each robot have both learning and evolution ability to adapt to dynamic environment. This paper proposes a pursuing system utilizing th...

متن کامل

Evolution of neural controllers for competitive game playing with teams of mobile robots

In this work, we describe the evolutionary training of artificial neural network controllers for competitive team game playing behaviors by teams of real mobile robots. This research emphasized the development of methods to automate the production of behavioral robot controllers. We seek methods that do not require a human designer to define specific intermediate behaviors for a complex robot t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003